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(54) Distributed processing system and distributed job processing method 



(57) A distributed computer system includes a stor- 
age device 32 for saving, in a referable manner, data 
pertaining to a history of execution of jobs processed by 
a computer; a queued job completion time computation 
function 1 05 and a server availability computation func- 
tion 106 which predict a completion time of a loaded job 



from the processing capability and operating status of 
the computer; and a job execution priority management 
function 103 for changing the priority of the loaded job 
in accordance with the predicted completion time of the 
job such that the job is completed within the execution 
time limit. 
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Description 

BACKGROUND OF THE INVENTION 
1 .Field of the Invention 

[0001] The invention relates to a distributed computer system which integrates a plurality of computers (or servers) 
distributed over a network, as well as to a distributed processing system and a distributed job processing method 
which effectively process a job loaded by a user, within a user's desired time limit. 

2.Description of the Related Art 

[0002] Nowadays, a computing system has become an important element in business activities, to such an extent 
that we can say with assurance that there remain no business activities which do not involve a computing system 
Particularly, as a result of proliferation of the Internet and relevant technological innovation, which started in the late 
1990s, a distributed computing system linked by way of a network has become more important than ever. 
[0003] A factor responsible for this is as follows. In association with globalization of business activities to the extent 
that business activities have become borderless, competition among corporations has become more severe Among 
business operations stemming from every site of business activities, processing of a certain business operation must 
be completed without fail within a predetermined period of time, even when this results in a delay in another business 
operation . If a corporation has failed to introduce a new product or service into the market earlier than competitors, the 
corporation cannot prevail in competition among corporations and fails to survive. 

[0004] In order to efficiently process, within a short period of time, business operations stemming from every site of 
business activities, corporations have introduced a large amount of administrative resources and established a large- 
scale distributed computer system, by means of interconnecting a plurality of computers (e.g., servers) by way of a 
local area network (LAN) or a wide area network. 

[0005] In relation to a case where a processing unit to be processed by a distributed computer system— which is 
called a job, a process, or a task— is executed by a computer (or a server), there have already been known a plurality 
of techniques which enable ascertainment of statuses of server resources and optimal distribution of jobs for effective 
so utilization of server resources and improvement of processing efficiency. 

[0006] As a method of distributing jobs in a distributed processing computer system, the following have already been 
practiced: (1 ) a method of distributing jobs at the time of startup thereof in accordance with the status of consumption 
of respective server resources, as described in Japanese Patent Application Laid-Open No. 1 1 406/1 998- (2) a method 
of predicting beforehand the amount of server resources which are to be consumed by jobs to be executed and of 
distributing the jobs such that an aggregate of server resources to be used by the jobs is not to exceed a total amount 
of resources of the server, as described in Japanese Patent Application Laid-Open No. 19864/1 998; and (3) a method 
of distributing jobs in accordance with a preset policy. 

[0007] As mentioned above, various techniques for efficiently processing jobs loaded in a distributed computer sys- 
tem have already been disclosed. However, there are disclosed substantially no techniques which, at the time of uti- 
lization of the distributed computer system, enable completion of jobs within a user's desired time limit 
[0008] Servers which constitute a large-scale distributed computer system are very expensive products Since the 
system is constituted of a large number of servers, each of the previously-described job distribution methods effectively 
utilizes server resources. 

[0009] When a user utilizes such a large-scale distributed computer system, billing has hitherto been performed on 
the basis of a track record of use of server resources, regardless of whether or not a job required by the user has been 
completed within a user's expected time limit. For example, there has been practiced a method in which the following 
information is saved in a job execution history: a department which has used respective server resources a user and 
hours during which the server resources have been used, and in which the thus-saved data are compiled. 
[0010] Two major problems are encountered in utilizing and operating such a large-scale distributed computer sys- 
tem. A first problem lies in that, when requesting a job, a user cannot ascertain beforehand whether or not the job will 
be completed wfthin the user's expected time limit. A second problem lies in that billing is performed on the basis of 
resources consumed by the job, regardless of whether or not the requested job has been completed within the usef s 
expected time limit. 
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[001 1 ] The conventional techniques enable efficient distribution of jobs loaded into a distributed computer system 
to respective servers in the sequence in which the jobs have been loaded. As a method of distributing jobs there is 
disclosed (1 ) the previously-described method of determining a way to distribute jobs in consideration of the availability 
status of respective servers at the time of startup of the jobs. 

[0012] Under this method, jobs are processed in the sequence in which the jobs have been loaded by the users. 
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Therefore, a completion time of a job changes greatly in accordance with the number of servers of the distributed 
computer system or the availability status thereof. Forthis reason, great difficulty is encountered when the user predicts 
a completion time of a job beforehand at the time of loading of the job. 

[0013] As another previously-described method of distributing jobs, there is disclosed (2) a method of selecting an 
5 optimum server in consideration of resources of servers which are available at the time of distribution of jobs and 
statuses of other jobs, and of executing the jobs when there are executed jobs involving use of a known amount of 
server resources over the lifetime of the jobs (i.e., over a period from the time the jobs are started until the time the 
jobs are completed). 

[0014] However, the user cannot ascertain completion times of the jobs loaded by other users when loading his/her 
10 job. Hence, under this method, the user cannot ascertain a completion time of the loaded job beforehand. 

SUMMARY OF THE INVENTION 

[001 5] Present business activities entail a necessity for processing various jobs; that is, a job which is to be processed 
is within a short period of time or a job whose processing involves consumption of several days. In the case of a single 
job whose processing involves consumption of several days, when the amount of server resources to be consumed 
during the lifetime of the job cannot be examined beforehand, the job distribution method cannot be used. 
[0016] In this way, the related-art job distribution methods are for efficiently processing jobs within the shortest periods 
of time in the sequence in which the jobs are loaded into a distributed computer system. However, these methods do 
20 not taken into consideration a timetable element; that is, a user's desired completion time of a job. 

[0017] in relation to billing processing of a related-art distributed computer system, track records of use of the com- 
puter system pertaining to jobs processed by respective servers (e.g., departments which have used the computer 
system, users, and operating hours) are compiled at a single location. A track record of use of the computer system 
is compiled on a per-user basis, and usage costs of the computer are billed. The track record of use of the computer 
25 used as a basis for billing a computer usage fee does not take into consideration whether or not the requested job has 
been completed within the user's desired time limit. 

[001 8] When the jobs have been processed in the sequence in which they had been loaded and if a job has not been 
completed within a user's expected time limit, the user's desire may be satisfied by means of executing his/her job at 
a higher priority than other jobs. The fact is that no consideration has hitherto been given to the quality of service for 
30 computer users. From the standpoint of users of a computer system, a track record of use of a computer system is 
preferably compiled in consideration of whether or not a user's requested job has been completed within a desired 
time limit. 

[001 9] The invention is to solve the above-described problems in the art and aims at providing a distributed processing 
system and a job distribution processing method, which enable prediction of a completion time of a user's requested 

35 job and distribution of jobs in consideration of completion time limits of jobs at the time of utilization of a computer system . 
[0020] The invention also aims at providing a distributed processing system and a job distribution processing method, 
which performs billing operation in accordance with a service afforded to a computer user in consideration of whether 
or not the user's requested job has been completed within a desired time limit. A distributed processing system ac- 
cording to aspect 1 of the invention corresponds to a distributed processing system including a plurality of computers 

40 linked together by way of a network, the system comprising means (a storage device 32) for saving, in a referable 
manner, execution history data pertaining to a job processed by the computers; means (a queued job completion time 
computation function 1 05) for specifying an execution time limit of a job loaded by a user of the computers; means (a 
server availability computation function 106) for predicting, from processing capacity and operating conditions of the 
computers and the execution history data pertaining to the job, a completion time of the job which is loaded by the user 
by means of designating an execution time limit; and means (a job execution priority management function 103) for 
changing the priority of the job in accordance with the predicted completion time thereof such that the job is completed 
within the time limit. 

[0021] By means of the distributed processing system according to aspect 1 , a completion time of a job is predicted 
from processing capacity and operating conditions of the computers and the execution history data pertaining to the 
so job. When a result of prediction has exceeded the execution time limit of a job of interest, the job can be completed 
within the designated execution time limit, by means of changing the priority of the job. 

[0022] According to aspect 2, the distributed processing system of aspect 1 is characterized in that the means for 
predicting a completion of a job enables prediction of a completion time of a job which is currently executed and pre- 
diction of completion times of queued jobs. 
55 [0023] By means of the distributed processing system of aspect 2, the means for predicting a completion time of a 
job enables prediction of a completion time of a job which is currently executed and prediction of completion times of 
queued jobs. Hence, there can be performed appropriate distribution of jobs involving effective utilization of resources 
such that a loaded job is completed within the shortest period of time. 
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[0024] According to aspects, the distributed processing system of aspect 1 or2 is characterized by further comprising 
means-for selecting from the execution history data a job analogous to the job loaded by the user, wherein the means 
for predicting a completion time of a loaded job predicts a completion time of a loaded job, by reference to execution 
history data pertaining to the selected analogous job. 

[0025] By means of the distributed processing system of aspect 3, provision of the means for selecting from the 
execution h.story data a job analogous to the job loaded by the user enables retrieval of an analogous job from the 
execution h.story data when an analogous job is unknown, thereby enabling an improvement in the accuracy of pre- 
diction of a completion time of a job. y H 
[0026] According to aspect 4, the distributed processing system of aspect 1 or2 is characterized by further comprising 
means for inputting apredicted execution time of ajob loaded by the user, wherein the means for predicting a completion 

wolr 3 r™J f C h T P J eti ° n time ° f 3 ' 0aded j0b ' by reference t0 the entered < P^icted execution time. 

[0027] By means of the d.stnbuted processing system of aspect 4, even when a job analogous to a loaded job has 
never been performed in the past, the completion time of the job can be predicted by means of the user entering a 
predicted execution time. Hence, processing of the system can be pursued 

[0028] According to aspect 5, the distributed processing system of any one of aspects 1 through 4 is characterized 
by further comprising charging means for increasing or decreasing a computer usage fee per unit time for a loaded 
job in accordance with a change in the priority of the job when the priority of the loaded job has been changed by the 
means for adjusting the priority of a loaded job. • a y 

[0029] By means of the distributed processing system of aspect 5, a computer usage fee per unit time for a loaded 
job ,s increased or decreased in accordance with a change in the priority of the job, thereby enabling billing operation 
wh,ch appropriately maintains a balance between the execution time limit designated by the user and a computer 
usage fee. ■ " ~ r 

[0030] According to aspect 6, the distributed processing system of any one of aspects 1 through 5 is characterized 
by further comprising charging means for increasing a computer usage fee per unit time for the loaded job when the 
pnority of the loaded job is increased by the means for changing the priority of a job 

[0031] By means of the distributed processing system of aspect 6, a computer usage fee per unit time for a loaded 
job is increased when the pnority of the job is increased, thereby enabling billing operation which appropriately maintains 
a balance between the execution time limit designated by the user and a computer usage fee 

[0032] According to aspect 7, the distributed processing system of any one of aspects 1 through 6 is characterized 
by further comprising charging means for increasing a computer usage fee per unit time for the loaded job when 
priorities of other jobs are lowered in order to increase the priority of the loaded job with use of the means for changing 
ine pnonry or 3 iod. 

[0033] By means of the distributed processing system of aspect 7, a computer usage fee per unit time for a job whose 
pnority has beer, owered for increasing the priority of another job is decreased, thereby enabling billing operation 
wh.ch appropriately maintains a balance between the execution time limit designated by the user and a computer 
usage fee. 

[0034] According to aspect 8, the distributed processing system of aspect 7 is characterized in that the charging 
means determines a computer usage fee such that there is achieved a counterbalance between the amount of decrease 
in the computer usage fee for the jobs whose priorities have been lowered and the amount of increase in the computer 
usage fee for the job whose pnonty has been increased. 
[0035] By means of the distributed processing system of aspect 8, there is performed a billing operation such that 
there js achieved a counterbalance between the amount of decrease in the computer usage fee for the jobs whose 
Z°r2 ' ■ B rJT n "T^ am ° Unt ° f inCreaSe the com P uter 'ee for the job whose priority has been 

43 system ^ SqUitably iSSUed t0 3 User without <*™9<"9 a computer usage fee of the entire processing 

[0036] According to aspect 9, the distributed processing system of any one of aspects 1 through 8 is characterized 
by f u rther comprising means for providing the shortest predicted completion time of the job when the job is not expected 
to be completed within a designated execution time limit even if the priority of the loaded job is changed 
so !S t ? m ! anS ? distr i buted Pressing system of aspect 9, when completion of the job is not expected to be 
completed within a designated execution time limit even if the priority of the loaded job is changed, a user can be 
prompted to take an appropriate countemieasure, by means of providing the shortest predicted completion time of the 

[0038] According to aspect 10, the distributed processing system of aspect 9 is characterized in that the predicted 
55 simulSneouTy ^ * ^ ^ * C ° mputer USage fee per unit time t0 be a PP |ied l ° the job are provided 
[0039] By means of the distributed processing system of aspect 1 0, when the job is not expected to be completed 
within a designated execution time limit, provision of information satisfying the user and prompting a user to take an 
appropriate countermeasure can be attained, by means of providing the shortest predicted completion time of the job 
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and a computer usage fee per unit time. 

[0040] A distributed job processing method according to aspect 1 1 of the invention corresponds to a distributed job 
processing method employing a plurality of computers linked together by way of a network, the system comprising the 
steps of specifying an execution time limit of a job loaded by a user of the computers (S21); predicting, from processing 

5 capacity and operating conditions of the computers and execution history data pertaining to the job processed by the 
computers, a completion time of the loaded job (S22 through S27); and changing the priority of the job in accordance 
with the predicted completion time thereof such that the job is completed within the time limit (S28: fail to complete a job). 
[0041] By means of the distributed job processing method according to aspect 11, a completion time of a job is 
predicted from processing capacity and operating conditions of the computers and the execution history data pertaining 

10 to the job. When a result of prediction has exceeded the execution time limit of a job of interest, the job can be completed 
within the designated execution time limit, by means of changing the priority of the job. 

[0042] According to aspect 1 2, the distributed job processing method of aspect 1 1 is characterized in that, in the step 
of predicting a completion of a job, there are predicted a completion time of a job which is currently executed and 
completion times of queued jobs. 
15 [0043] By means of the distributed job processing method of aspect 12, in the step of predicting a completion time 
of a job, there can be separately predicted a completion time of a job which is currently executed and completion times 
of queued jobs. Hence, there can be performed appropriate distribution of jobs involving effective utilization of resources 
such that a loaded job is completed within the shortest period of time. 

[0044] According to aspect 13, the distributed job processing method of aspect 11 or 12 is characterized by further 
20 comprising the steps of electing from the execution history data a job analogous to the job loaded by the user; and 
predicting a completion time of a loaded job, by reference to execution history data pertaining to the selected analogous 
job. 

[0045] By means of the distributed job processing method of aspect 13, provision of the means for selecting from 
the execution history data a job analogous to the job loaded by the user enables retrieval of an analogous job from the 
25 execution history data when an analogous job is unknown, thereby enabling an improvement in the accuracy of pre- 
diction of a completion time of a job. 

[0046] According to aspect 14 : the distributed job processing method of any one of aspects 11 through 13 is char- 
acterized by further comprising the steps of inputting a predicted execution time of a job loaded by the user; and 
predicting a completion time of a loaded job, by reference to the entered, predicted execution time. 
30 [0047] By means of the distributed job processing method of aspect 1 4, even when a job analogous to a loaded job 
has never been performed in the past, the completion time of the job can be predicted by means of the user entering 
a predicted execution time. Hence, processing of the system can be pursued. 

[0048] According to aspect 15 : the distributed job processing method of any one of aspects 1 1 through 14 is char- 
acterized by further comprising the step of increasing or decreasing a computer usage fee per unit time for a loaded 
35 job in accordance with a change in the priority of the job when the priority of the loaded job has been changed in the 
step of adjusting the priority of a job. 

[0049] By means of the distributed job processing method of aspect 15, a computer usage fee per unit time for a 
loaded job is increased or decreased in accordance with a change in the priority of the job, thereby enabling billing 
operation which appropriately maintains a balance between the execution time limit designated by the user and a 
40 computer usage fee. 

[0050] According to aspect 16, the distributed job processing method of any one of aspects 11 through 15 is char- 
acterized by further comprising the step of increasing a computer usage fee per unit time for the loaded job when the 
priority of the loaded job is increased in the step of changing the priority of a job. 

[0051] By means of the distributed job processing method of aspect 16, a computer usage fee per unit time for a 
45 loaded job is increased when the priority of the job is increased, thereby enabling billing operation which appropriately 
maintains a balance between the execution time limit designated by the user and a computer usage fee. 
[0052] According to aspect 1 7, the distributed job processing method of any one of aspects 11 through 1 6 is charac- 
terized by further comprising the step of increasing a computer usage fee per unit time for the loaded job when priorities 
of other jobs are lowered in order to increase the priority of the loaded job in the step of changing the priority of a job. 
so [0053] By means of the distributed processing system of aspect 17, a computer usage fee perunit time for a job 
whose priority has been lowered for increasing the priority of anotherjob is decreased, thereby enabling billing operation 
which appropriately maintains a balance between the execution time limit designated by the user and a computer 
usage fee. 

[0054] According to aspect 18, the distributed job processing method of 17 is characterized by further comprising 
55 the step of determining a computer usage fee such that there is achieved a counterbalance between the amount of 
decrease in the computer usage fee for the jobs whose priorities have been lowered and the amount of increase in 
the computer usage fee for the job whose priority has been increased. 

[0055] By means of the distributed processing system of aspect 1 8, there is performed a billing operation such that 
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there is achieved a counterbalance between the amount of decrease in the. computer usage fee for the jobs whose 
priorities have been lowered and the amount of increase in the computer usage fee for the job whose priority has been 
increased. A bill can be equitably issued to a user without changing a computer usage fee of the entire processing 
system. 

[0056] According to aspect 19 : the distributed job processing method of any one of aspects 1 1 through 1 8 is char- 
acterized by further comprising the step of providing the shortest predicted completion time of the job when the job is 
not expected to be completed within a designated execution time limit even when the priority of the loaded job is 
changed. 

[0057] By means of the distributed processing system of aspect 1 9, when the job is not expected to be completed 
within a designated execution time limit even if the priority of the loaded job is changed, a user can be prompted to 
take an appropriate countermeasure, by means of providing the shortest predicted completion time of the job. 
[0058] According to aspect 20, the distributed job processing method of aspect 1 9 is characterized by further com- 
prising the step of simultaneously providing the predicted shortest completion time of the job and a computer usage 
fee per unit time to be applied to the job. 

[0059] By means of the distributed processing system of aspect 20, when the job is not expected to be completed 
within a designated execution time limit, provision of information satisfying the user and prompting a user to take an 
appropriate countermeasure can be attained: by means of providing the shortest predicted completion time of the job 
and a computer usage fee per unit time. 

20 BRIEF DESCRIPTION OF THE DRAWINGS 

[0060] 

Fig. 1 is a block diagram showing the configuration of a distributed processing system according to an embodiment 
25 of the invention; 

Fig. 2 is a block diagram showing an example configuration of the principal functions of the distributed processing 
system according to the embodiment; 

Fig. 3 is a flowchart for describing the operation of the distributed processing system according to the embodiment; 
Fig. 4 is a view showing a job request format to be sent to a job queuing server; 
30 Fig. 5 is a view showing a result of retrieval of analogous jobs in list form; 

Fig. 6 is a view showing a data format to be used for managing operating conditions of respective servers; 
Fig. 7 is a view showing an attribute format pertaining to a queued job under management of the job queuing server; 
Fig. 8 is a view showing a storage format of job execution history data; 
Fig. 9 is a flowchart for describing operation of charge aggregation operation; and 

Fig. 1 0 is a view showing an output format of a track record report about usage hours of a CPU according to a user. 
DESCRIPTION OF THE PREFERRED EMBODIMENTS 

[0061] An embodiment of the invention will be described by reference to the accompanying drawings. Fig. 1 is a 
block diagram showing the configuration of a distributed computer system which implements a distributed processing 
system according to an embodiment of the invention. Fig. 2 is a block diagram showing an example functional config- 
uration of a job queuing server which materializes primary functions according to the invention in connection with the 
distributed computer system shown in Fig. 1. 

[0062] As shown in Fig. 1 , a client 2 is a computer which loads a job. A job queuing server 31 is a computer which 
determines a priority of a job for completing the job within a user's desired time limit, searches for a server capable of 
optimally executing the job, and distributes the job to such a server. A storage device 32 for saving data pertaining to 
the history of execution of a job (hereinafter simply called "job execution history data") is connected to the job queuing 
server 31. 

[0063] File servers 41 , 42 are computers for holding an input file and an application program, which are to be used 
for a job. Servers 51 ; 52, and 53 are computers for executing a job. A charge aggregation server 6 is a computer for 
effecting a charging operation on the basis of job execution history data. A job file, an input file, and an application file 
are stored in a storage device connected to the servers 41 , 42. 

[0064] The client 2 and the servers 31,41, 42, 51 , 52, 53, and 6 are electronic computers, such as personal computers 
and workstations. They are interconnected by way of local area networks 1 0, 12 and a wide area network 11 . 
[0065] As shown in Fig. 2, the job queuing server 31 comprises a job history reference function 101 for referring to 
data pertaining to a history of jobs executed in the past; a job history saving function 102 for saving job execution 
history data; a job execution priority management function 103 for determining a priority of a job such that a job is to 
be completed within a user's desired time limit; a job distribution function 1 04 of selecting an optimal server for executing 
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a loaded job and automatically distributing the job to the thus-selected server; a queued job completion time compu- 
tation function 105 of predicting a completion time of a queued job; a server availability computation function 106 of 
predicting a completion time of processing being executed by a server; a server performance management function 
107 for normalizing the capacity of a server which executes a job; and a server operation schedule management 
5 function 1 08 for managing a planned schedule for a server which executes a job. 

[0066] The operation of the distributed computer system having the foregoing configuration will now be described 
by reference to a flowchart shown in Fig. 3. 

[0067] When a user of the client 2 executes a job, in step S21 the user specifies an execution time limit in the form 
of a job request form shown in Fig. 4, thus loading the job into the job queuing server 31. At this time, if there is no job 

10 completion time or desired time limit, the user specifies numeral "0" in an expected job completion date field. 

[0068] If a job analogous to the job which is to be executed this time has ever been executed and the user knows 
an execution number of the analogous job, the user specifies the execution number of the analogous job. If a job 
analogous to the job which is to be executed this time has ever been executed but the user does not know the execution 
number of the analogous job, the user specifies numeral "0" for the execution number of the analogous job. If a job 

15 analogous to the job which is to be executed this time has never been executed, the user specifies a special character 
"* M and a user's predicted time (seconds) which will be required before completion of a job next to numeral "1 ." 
[0069] Next, in step S22 a determination is made as to whether or not the execution number of the analogous job is 
designated. If numeral M 0" is specified, processing proceeds to step S23. In contrast, if a special character "*" and a 
user's predicted time (seconds) which will be required before completion of a job are specified next to numeral "1," 

20 processing proceeds to step S25. If the execution number of the analogous job is designated with a numeral other 
than those set forth, processing proceeds to step S24. 

[0070] If the user has specified numeral "0" as the execution number of the analogous job, in step S23 the analogous 
job is retrieved from job execution history data 32 by means of the job history reference function 1 01 . At that time, the 
job history reference function 101 utilizes, e.g., a user's name, the kind of a job, and the name of a task unit group. 

25 The job queuing server 31 displays a list of results of retrieval of analogous jobs in the form of an analogous job display 
format shown in Fig. 5. The user selects an execution number of an analogous job. When the execution number of the 
analogous job has become known by means of any one of the methods, in step S24 the job history reference function 
101 searches, from the job history data 32, for a time which will be required before completion of the job. 
[0071 ] Next, the availability of the server capable of executing the job loaded this time is computed, by means of the 

30 server availability computation function 1 06. Specifically, a completion time of the loaded job is precisely predicted on 
the basis of a job progress rate of the job currently executed in the server and an operation schedule of the server. 
[0072] The server availability computation function 106 receives information about computation capability of each 
server (SPEC) from the server performance management function 107, which manages computation capability of each 
server. For instance, computation capability is computed by the following equation. 

35 

SPEC = Frequency of a CPU (MHz) x the number of CPUs x real 
storage capacity (MB) 

40 

[0073] Next, the server availability computation function 1 06 ascertains a timetable and hours during which a server 
will be available with regard to the respective servers, by way of the server operation schedule management function 
1 08. For example, if a server is described as being scheduled to stop operation 1 2 hours from now, the server is omitted 
from candidates available for a job. 
45 [0074] Finally, in order to compute a job progress rate of each server (PROG), the server availability computation 
function 1 06 merges operating conditions of respective servers in the data format shown in Fig. 6. At this point in time, 
the availability (AVA) of each server with regard to queued jobs can be computed. For example, a job progress rate 
and availability can be computed in the following manners: 

50 

PROG = time elapsed for executing a job (seconds) x time required 
until completion of the job (seconds) 

55 

AVA = job progress rate (PROG) x computation capability of a server 

(SPEC) 
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whi^h K t6P S25 ' th * aVailabi,ity < AVA > of respective servers is computed, and computation results of all servers 
which have been compiled are used as availability. 

[0076] Next, there will be computed a time required until completion of N queued jobs. Queued jobs are manaqed 
by the job queuing server 31 in an attribute format shown in Fig. 7. Job consumption capability is determined by means 

pLs , oS;ob^^o p n?s) on capability (SPEC) required for comp,etin9 a job ° f interest by a « me required = - 

[0077] For instance, job consumption capability of a job for which a server of SPEC=100 requires 50 seconds is 
determined as 100 x 50 = 5000. When this job is executed by a server having computation capabi.IJ SPEC T= 200 a 
time (Quitime) required until completion of the job becomes 5000/200 = 25 (seconds) 

LSi^r P Tl ° T ° apable ° f eXSCUtin9 th6 qU6Ued j° bs - The result ° f di ™°" * added to the 
queued ?b C ° mP P 1 th£reby COmpUtin 9 the tims < Quitime ) squired until completion of a currently- 

15 fimT, 1 J?*" th H e iS determined a ^d^ment for completing within a time limit a job requested by the user this 

Z T ' 3 d h eterm,nati ° n iS madS 38 t0 Wheth6r ° r not the wi " be competed by a user's desired date 
and time, by means of changing the priorities of queued jobs. 

[0080] In a case where priorities of queued jobs are changed, a computer usage fee per unit time is assumed to 
arise as compared with that which will be incurred in a normal situation. At that time, reference i. ^ 
20 usage fee per^Ze. " S6rVer 6 with re 9 ard to »• rate of revision of a computer 

[0081] Criteria for revision of computer usage fees are as follows 

[0082] Criteria 1 : In relation to a job 1 which can be completed by a designated, desired completion date by means 

time Z^n " h ° t ^Tl^' * qUeued J '° bS ^ Chan£ > ed Within a in »• -e.s des' d 

2s Tl Zl * , 6V ; ^ 'I"" 16 ' * ^ fee Which is one rank th *" a <«ly applicable 

25 computer usage fee is applied to the job 1 . y 

^LhT'T^ th K 6 ° f thS qUSUed j ° b 1 f ° r WhiGh 3 desired cor "P'etion date has been designated is 

increased so as to become h.gher than that of a job 2 for which no desired completion date is designated a computer 
usage fee which ,s one rank higher than that applied to the job 2 is applied to the job 1 . At this time a computer usage 
,„ aPP " ed t0 thS J ° b 2 iS ' 0Wered by ° ne rank as spared to that currently applied to the job 1 

[0084] In step S27 on the basis of such criteria, a determination is made as to whether or not a job will becompleted 
by a user's des.red time limit (i.e., Reqtime), by means of, e.g., the following computation equation. 



35 



Reqtime > current time + availability (AVA) + completion time of a queued job (Qutime) 

n A d6te ™ nation ' S " 1ade in the fo,lowin 9 three wa V s b V me ^ns of the equation. A first determination is directed 
S29 In IT' 3 3 J ° b ° mtereSt T bS C0mpl6ted by a User * s desired time limit - a " d Pressing proceeds to step 
£ w7p^1K5S^ ,|, ' ^ ^ ^ ' 3 r6qUiSite C ° mP,etin9 3 j ° b by K US ^ S deSirad 

40 ™ fo ! JeXt ' ! J f r rende ? 3 fina ' determination ° f whether or not to execute a job, on the basis of the computer 
exSutlri Un t,me t prOVlded by the J' ob dueuin 9 se ™ 31 and expected completion times. If the job is noTto be 
executed, process.ng is terminated .n step S30. In contrast, if the job is to be executed, in step S32 various data sets 

Kr P ,I SES. hi8t0ry ^ ^ ^ ^ j ° b " hhto * *» 32 in - ~i format ZT„Z 

45 determ ' nati ° n ' s directed toward a case w here a user's desire cannot be satisfied, in which case a 

delegation ,s agam rendered by means of increasing the priority of a queued job of interest by one rank. To this 
end, the number of queued jobs N is reduced by one, and processing returns to step S25, where a determined is 
repeated by means of the computation equation. termination is 

so *!!TL^I$^™T? iS t0Ward 3 C3Se Where 3 j0b ° f interest cannot be ex P ected *° be completed 

by a user s des.red trme .,m.t even when the priority of the queued job is increased to the highest priority level In this 

execuLTth? STf t0 T< ' Whbh Sn eXP6Cted COmpleti °" da ** which will be achieved when the job is 
Tr^to^uT " tlm6 PmM " t0 ^ 3 °° mpUter ^ fee per unit «™ fe 

55 f.3nn of??? 9 ^^ embodiment ' a J ob is completed by a user's desired time limit in consideration of operating 
55 condibon of a drstnbuted computer system. Hence, there is implemented a function of linking a change in job priori™ 
o, JTS Ute t r h USage J ee w per Unit time Even when a use r"s desire cannot be satisfied, there is implemented a function 
of sat sfymg the user's des.re to the extent possible, by means of implementing a function of providing the shortes" 
completion schedule of a job to the user. proving me snortest 
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[0090] Next, the charge aggregation processing of the embodiment will be described by reference to a flowchart 
shown in Fig. 9. The charge aggregation server 6 has the function of compiling charge aggregation information, which 
is based on a computer usage fee per unit time set at the time of changing of priority of a queued job, from the job 
execution history data saved in step S32 and of outputting the thus-compiled information. 
5 [0091] In step S33, a computer usage fee is computed on a per-user basis from the information which assumes the 
storage format of the job execution history data 32 and is shown in Fig. 8. For instance, a computer usage fee is 
computed on a user-by-user basis in the output format shown in Fig. 10. Here, an individual computer usage fee is 
determined, by means of multiplying a computer usage fee per unit time by a time which elapses before completion 
of a job. 

10 [0092] As mentioned above, in the present embodiment, there is embodied a function of billing a computer usage 
fee in accordance with a rate of revision of a priority when a user has changed priorities of queued jobs in order to 
complete a job by a user's desired date and time. In this way, when a user uses a distributed computer system with a 
higher priority, a bill corresponding to the use of the system can be issued, thereby providing equitable service to users. 
[0093] As has been described, according to the invention, a user predicts a completion time of his/her requested job 

15 beforehand and changes the priority of the job while ascertaining operating status of a computer. As a result, there are 
provided a distributed processing system and a distributed job processing method, which provide jobs in consideration 
of a user's desired completion time limit. 

[0094] Further, the invention has embodied a function of linking a change in the priority of a queued job with a 
computer usage fee per unit time. There is performed billing operation which takes into consideration a case where a 
20 requested job cannot be completed with a user's desired time limit. As a result, there can be provided a distributed 
processing system and a distributed job processing method, which issue bills to users equitably. 
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40 



Claims 
1 



A distributed processing system including a plurality of computers linked together by way of a network, the system 
comprising: 

means for saving, in a referable manner, execution history data pertaining to a job processed by the computers; 
30 means for specifying an execution time limit of a job loaded by a user of the computers; 

means for predicting, from processing capacity and operating conditions of the computers and the execution 
history data pertaining to the job, a completion time of the job which is loaded by the user by means of des- 
ignating an execution time limit; and 

means for changing the priority of the job in accordance with the predicted completion time thereof such that 
35 the job is completed within the time limit. 

2. The distributed processing system according to claim 1 , wherein the means for predicting a completion time of a 
job enables prediction of a completion time of a job which is currently executed and prediction of completion times 
of queued jobs. 



3. The distributed processing system according to claim 1 or 2, further comprising: 



means for selecting from the execution history data a job analogous to the job loaded by the user, wherein 
the means for predicting a completion time of a loaded job predicts a completion time of a loaded job, by 
45 reference to execution history data pertaining to the selected analogous job. 

4. The distributed processing system according to claim 1 or 2, further comprising: 

means for inputting a predicted execution time of a job loaded by the user, wherein the means for predicting 
so a completion time of a loaded job predicts a completion time of the loaded job, by reference to the entered, 

predicted execution time. 

5. The distributed processing system according to claim 1 or 2, further comprising: 

55 charging means for increasing or decreasing a computer usage fee per unit time for a loaded job in accordance 

with a change in the priority of the job when the priority of the loaded job has been changed by the means for 
adjusting the priority of a loaded job. 
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6. The distributed processing system according to claim 1 or 2, further composing: 

charging means for increasing a computer usage fee per unit time for the loaded job when the priority of the 
loaded job is increased by the means for changing the priority of a job. - 

7. The distributed processing system according to claim 1 or 2, further comprising: 

charging means for increasing a computer usage fee per unit time for the loaded job when priorities of other 
jobs are lowe red in order to increase the priority of the loaded job with use of the means for chanqinq the 
10 priority of a job. y 

8. The distributed processing system according claim 7, wherein the charging means determines a computer usage 
fee such that there is achieved a counterbalance between the amount of decrease in the computer usage fee for 
the jobs whose priorities have been lowered and the amount of increase in the computer usage fee for the job 

15 whose priority has been increased. 

9. The distributed processing system according to claim 1 or 2, further comprising: 

means for providing the shortest predicted completion time of the job when the job is not expected to be 
completed within a designated execution time limit even if the priority of the loaded job is changed. 

10. The distributed processing system according to claim 9, wherein the predicted shortest completion time of the job 
and a computer usage fee per unit time to be applied to the job are provided simultaneously. 

11. A distributed job processing method employing a plurality of computers linked together by way of a network the 
method comprising the steps of: 

specifying an execution time limit of a job loaded by a user of the computers; 

predicting, from processing capacity and operating conditions of the computers and execution history data 
pertaining to the job processed by the computers, a completion time of the loaded job; and 
changing the priority of the job in accordance with the predicted completion time thereof such that the job is 
completed within the time limit. 

12. The distributed job processing method according to claim 11, wherein, in the step of predicting a completion time 
of a job, there are predicted a completion time of a job which is currently executed and completion times of queued 
jobs. 

13. The distributed job processing method according to claim 11 or 12, further comprising the steps of: 

selecting from the execution history data a job analogous to the job loaded by the user; and 
predicting a completion time of a loaded job, by reference to execution history data pertaining to the selected 
analogous job. 

14. The distributed job processing method according to claim 11 or 12, further comprising the steps of: 
inputting a predicted execution time of a job loaded by the user; and 

predicting a completion time of a loaded job, by reference to the entered, predicted execution time. 

15. The distributed job processing method according to claim 11 or 12, further comprising the step of: 

increasing or decreasing a computer usage fee per unit time for a loaded job in accordance with a change in 
cJVjob^ ° f When Pr ' 0rity ° f '° aded j0b has been chan 9 ed in the step of adjusting the priority 

16. The distributed job processing method according to claim 11 or 12, further comprising the step of: 

increasing a computer usage fee per unit time for the loaded job when the priority of the loaded job is increased 
in the step of changing the priority of a job. 
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17. The distributed job processing method according to claim 11 or 12, further comprising the step of: 

increasing a computer usage fee per unit time for the loaded job when priorities of other jobs are lowered in 
order to increase the priority of the loaded job in the step of changing the priority of a job. 

5 

18. The distributed job processing method according claim 1 7, further comprising the step of: 

determining a computer usage fee such that there is achieved a counterbalance between the amount of de- 
crease in the computer usage fee for the jobs whose priorities have been lowered and the amount of increase 
10 in the computer usage fee for the job whose priority has been increased. 

19. The distributed job processing method according to claim 11 or 12, further comprising the step of: 

providing the shortest predicted completion time of the job when the job is not expected to be completed within 
15 a designated execution time limit even when the priority of the loaded job is changed. 

20. The distributed job processing method according to claim 19, further comprising the step of: 

simultaneously providing the predicted shortest completion time of the job and a computer usage fee per unit 
20 time to be applied to the job. 

21. A recording program in which a distributed job processing method is performed, said distributed job processing 
method being applied to a plurality of computers linked together by way of a network, comprising the steps of: 

specifying an execution time limit of a job loaded by a user of the computers; 

predicting, from processing capacity and operating conditions of the computers and execution history data 
pertaining to the job processed by the computers, a completion time of the loaded job; and 
changing the priority of the job in accordance with the predicted completion time thereof such that the job is 
completed within the time limit. 

22. A recording medium in which a distributed job processing method is stored, said distributed job processing method 
being applied to a plurality of computers linked together by way of a network, comprising the steps of: 

specifying an execution time limit of a job loaded by a user of the computers; 
35 predicting, from processing capacity and operating conditions of the computers and execution history data 

pertaining to the job processed by the computers, a completion time of the loaded job; and 
changing the priority of the job in accordance with the predicted completion time thereof such that the job is 
completed within the time limit. 
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